Persistent random walks , variable length Markov chains and piecewise deterministic Markov processes ∗

نویسندگان

  • Peggy Cénac
  • Brigitte Chauvin
  • Samuel Herrmann
  • Pierre Vallois
چکیده

A classical random walk (St, t ∈ N) is defined by St := t ∑ n=0 Xn, where (Xn) are i.i.d. When the increments (Xn)n∈N are a one-order Markov chain, a short memory is introduced in the dynamics of (St). This so-called “persistent” random walk is nolonger Markovian and, under suitable conditions, the rescaled process converges towards the integrated telegraph noise (ITN) as the time-scale and space-scale parameters tend to zero (see [11, 17, 18]). The ITN process is effectively non-Markovian too. The aim is to consider persistent random walks (St) whose increments are Markov chains with variable order which can be infinite. This variable memory is enlighted by a one-to-one correspondence between (Xn) and a suitable Variable Length Markov Chain (VLMC), since for a VLMC the dependency from the past can be unbounded. The key fact is to consider the non Markovian letter process (Xn) as the margin of a couple (Xn,Mn)n≥0 where (Mn)n≥0 stands for the memory of the process (Xn). We prove that, under a suitable rescaling, (Sn, Xn,Mn) converges in distribution towards a time continuous process (S(t), X(t),M(t)). The process (S(t)) is a semi-Markov and Piecewise Deterministic Markov Process whose paths are piecewise linear. 2010 Mathematics Subject Classification. 60J10, 60J27, 60F05, 60G17, 60G40, 60K15.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Total Variation Discrepancy of Deterministic Random Walks for Ergodic Markov Chains

Motivated by a derandomization of Markov chain Monte Carlo (MCMC), this paper investigates deterministic random walks, which is a deterministic process analogous to a random walk. While there are several progresses on the analysis of the vertex-wise discrepancy (i.e., L∞ discrepancy), little is known about the total variation discrepancy (i.e., L1 discrepancy), which plays a significant role in...

متن کامل

Markov processes of infinitely many nonintersecting random walks

Consider an N -dimensional Markov chain obtained from N onedimensional random walks by Doob h-transform with the q-Vandermonde determinant. We prove that as N becomes large, these Markov chains converge to an infinite-dimensional Feller Markov process. The dynamical correlation functions of the limit process are determinantal with an explicit correlation kernel. The key idea is to identify rand...

متن کامل

Compositional Modeling and Minimization of Time-Inhomogeneous Markov Chains

This paper presents a compositional framework for the modeling of interactive continuous-time Markov chains with time-dependent rates, a subclass of communicating piecewise deterministic Markov processes. A poly-time algorithm is presented for computing the coarsest quotient under strong bisimulation for rate functions that are either piecewise uniform or (piecewise) polynomial. Strong as well ...

متن کامل

Markov Processes of Infinitely Many Nonintersecting Random Walks Publisher Accessed Terms of Use Detailed Terms Markov Processes of Infinitely Many Nonintersecting Random Walks

Consider an N -dimensional Markov chain obtained from N onedimensional random walks by Doob h-transform with the q-Vandermonde determinant. We prove that as N becomes large, these Markov chains converge to an infinite-dimensional Feller Markov process. The dynamical correlation functions of the limit process are determinantal with an explicit correlation kernel. The key idea is to identify rand...

متن کامل

A simple and efficient solution of the identifiability problem for hidden Markov processes and quantum random walks

A solution of the identifiability problem (IP) for hidden Markov processes (HMPs), based on a novel algebraic theory for random sources, is presented. It gives rise to an efficient and practical algorithm that can be easily implemented. Extant approaches are exponential in the number of hidden states and therefore only applicable to a limited degree. The algorithm can be equally applied to solv...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012